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Computation across the curriculum: What skills are needed? 
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Computation, the use of a computer to solve, simulate, or visualize a physical problem, has 
revolutionized how physics research is done. Computation is used widely to model systems, to 
simulate experiments, and to analyze data. Yet, in most undergraduate programs, students have 
little formal opportunity to engage with computation and, thus, are left to their own to develop 
their computational expertise. As part of a larger project to study how computation is incorporated 
in some undergraduate physics programs (and how it might be incorporated further), we convened a 
mini-conference and conducted a series of interviews with industry professionals, academic faculty, 
and employed bachelor’s graduates who make use of computation in their everyday work. We present 
preliminary results that speak to how participants developed the requisite skills to do professional 
computational work and what skills they perceive are necessary to conduct such work. 
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I. INTRODUCTION 

While computation has revolutionized modern science 
research [l|, much of the undergraduate physics curricu¬ 
lum remains as it was in the 1960s 0 - e.g., emphasiz¬ 
ing the construction of analytical solutions to long-solved 
problems. With advent of powerful computers as well as 
the development of high-level programming languages, 
we are capable of modeling phenomenon that a genera¬ 
tion ago would have required sophisticated tools. And 
yet, many of our programs have not yet incorporated 
computation into the undergraduate experience Q. 

A new push to incorporate computation into the un¬ 
dergraduate curriculum is occurring that builds on 
the successes of the past ii , but also aims to incor¬ 
porate results from physics education research 0- As a 
step towards building this effort, we convened a two-day, 
30-person conference of industry professionals, academic 
faculty, and employed physics bachelor’s graduates who 
make use of computation in their everyday work. The 
overarching purpose of this conference was to articulate 
goals for a national survey that will investigate the state 
of computation in undergraduate physics departments. 
Follow-up interviews were conducted with a purposefully 
selected group of participants to further develop our un¬ 
derstanding of what they perceive as goals for teaching 
computation, how their own computational learning was 
supported, and how their current organization continues 
to support their (and others’) learning. 

In this paper, we report on the skills physics bachelor’s 
graduates should develop from the perspective of confer¬ 
ence and interview participants. This study makes use of 
field notes and interviews, and analyzes this data from a 
phenomenongraphic perspective to represent diversity of 
participants’ views while seeking coherence among those 
views |ll| . This preliminary study acts as a starting point 
for developing more concrete curricular and pedagogical 
structures for teaching computation in physics courses. 


II. DATA 

The discussions at the conference and during the post¬ 
conference interviews provided information on a wide 
range of issues around computation. The structure of the 
conference was such that we could collect field notes of 
small group and larger plenary discussions. Researchers 
acted as participant-observers who facilitated conversa¬ 
tion, but allowed participants to carry the conversation 
in both small group and larger discussions. While all re¬ 
searchers collected their own notes, a single researcher 
was dedicated to collecting field notes. Field notes were 
discussed and edited during and after the conference to 
represent each researcher’s recollection of the discussions. 

During the conference, we identified participants with 
whom to conduct follow-up interviews. We gave prece¬ 
dence to employed physics bachelor’s graduates and those 
who employ them including academic faculty and in¬ 
dustry professionals. Ultimately, we interviewed one- 
fifth of conference attendees. One-hour interviews were 
conducted with two employed physics bachelor’s gradu¬ 
ates (Britta & Annie), two academic faculty who advise 
doctoral candidates on computational physics research 
(Frankie & Jeff), one industry professional (Pierce), and 
one academic faculty who develops instructional materi¬ 
als for physics courses (Leonard). Some similarities, but 
also clear differences between the experiences of junior 
and senior interviewees emerged from the analysis. 

We offer an overview of the analysis of our data 
(Sec. mil) to give sufficient space to present our results 
(Sec. IIVI) and discussion (Sec. IVT). 

III. ASSUMPTIONS AND METHODS 

The data that we collected have provided a wealth of 
information about many aspects of computation in gen¬ 
eral, computational instruction, and the necessary skills 
for undergraduates to develop. Our analysis in this pa- 


2 


per has focused exclusively on participants’ perceptions 
of the skills that undergraduates need to develop with re¬ 
gard to computation. We have not wholly neglected these 
other important aspects of our data, but for the purposes 
of this paper we have foregrounded participants’ discus¬ 
sions around computational skills in our analysis. 

We should also note that our participants and inter¬ 
viewees were not (generally) grounded in educational re¬ 
search and do not appear to subscribe to any particular 
definition of “skill.” Thus, we have taken a broad view 
of “skills,” as it appears our participants and intervie¬ 
wees did, which includes knowledge of certain concepts, 
specific practices, and ways of thinking. 

To analyze the collected data, we open-coded field 
notes and interviews under the aforementioned assump¬ 
tions (i.e., looking for specific discussions of computa¬ 
tional skills). This initial coding process revealed a num¬ 
ber of similarities among the conference participants’ dis¬ 
cussions and interviewee’s comments. Further review of 
tagged interview sections fleshed out these commonali¬ 
ties as well as the nuance between different interviewee’s 
perceptions. In what follows, we present our interpre¬ 
tation of the common computational skills discussed by 
conference participants and interviewees along with some 
of the observed nuances. 


IV. COMPUTATIONAL SKILLS 

Conference and interview participants presented a 
number of different computational skills in discussion and 
in interviews. Our categorization of these skills is based 
on a triangulated coding of field notes and interview re¬ 
sponses. We do not claim that ours is the only catego¬ 
rization possible for such data, but that it is consistent 
with our assumptions and that it lends itself to be in¬ 
terpretable for our purposes readily. We discuss each 
category of skills beginning with those articulated in the 
conference, offer sample responses from interviews that 
provide evidence for the presence of each category, and 
comment on the nuance between interview participant’s 
responses around each category. 

Knowledge of specific physics &: computational 
concepts 

Central to much of the early discussion at the con¬ 
ference was the particular physical and computational 
concepts that were necessary for students to learn dur¬ 
ing their degree program. The physics topics that were 
discussed mirrored the canon of topics presented in a 
typical physics major. The computational concepts that 
were raised spanned a variety of iterative concepts and 
included well-established numerical methods (e.g., relax¬ 
ation & Monte Carlo methods) as well newer concepts 
for data science (e.g., anomaly detection, clustering). 

The centrality of specific physical and computational 
concepts was present to a lesser degree in interviews (by 
design), but was still articulated by all interviewees. The 


specific topics raised depended directly on the intervie¬ 
wee’s line of work or research. For example, Britta, a 
first-year graduate student in soft matter, responded to a 
line of inquiry about what a new graduate student might 
need to know to work in her lab, 

Britta ...a good, solid classical mechanics 
background as well. We’re having trouble im¬ 
plementing rigid body dynamics in our code 
now because we ’re not sure if there’s frictional 
forces going on with our particle or it’s the lu¬ 
brication force that is really dominating. So 
if you don’t know the physics going on behind 
that, how can you put it into the computer? 

In this snippet, Britta mentions a number of physics 
concepts that are needed in her work (e.g., rigid body 
dynamics) explicitly, but she also mentions putting that 
physics into the computer, which, from other parts of 
her interview, point to different forms of numerical inte¬ 
gration. More senior interviewees (Jeff, Pierce, Leonard, 
and Frankie) also discussed specific physics and compu¬ 
tational concepts used in their work, but they did not 
often couch those discussions in particular projects as 
Britta does. Instead, it was common for senior intervie¬ 
wees to describe broader aspects of learning computing. 

Use of specific computational practices 

In addition to students knowing particular concepts, 
they must engage with specific computational practices. 
Conference attendees raised a number of practices that 
can be categorized broadly as planning, modeling, pro¬ 
gramming, debugging, analysis, and visualization. These 
practices are particular kinds of actions that attendees 
felt were important for students to develop fluency with. 
Interviewees echoed these practices and further defined 
them. For example, Britta discussed the importance of 
planning (i.e., writing pseudocode), 

Britta Sometimes I would have an idea and 
I would think about the physics but I never 
really articulate it. Writing pseudocode and 
working through the mathematics before vom¬ 
iting the code out that made a difference. 

Remarks from interviewees suggested that these prac¬ 
tices are important for students to engage in modern sci¬ 
ence work (all), but are often lacking from the under¬ 
graduate experience (Jeff, Leonard, and Frankie). 

Computational ways of thinking 

During the conference, attendees often alluded to 
“computational thinking” or “thinking iteratively ” as 
desirable skills for students to develop. Such terms ap¬ 
pear in the literature, but are often nebulous [l^ . In 
interviews, some more senior interviewees (Jeff, Pierce, 
and Leonard) raised the issue of computational thinking 
spontaneously and unpacked it to various degrees. For 
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example, Jeff, a professor who conducts computational 
astrophysics research, discussed computational thinking 
as breaking down a problem into its finest components. 
He, then, mentioned how difficult that is to learn, 

Jeff [thinking computationally is] thinking 
about it [the task/problem] in the very spe¬ 
cific steps of what needs to be done that often 
is hard for people to get into... once you learn 
to break it down...I think getting to think that 
way, that’s the challenging part. 

Pierce and Leonard also raised issues associated with 
breaking down a complex task into bits of code, but 
Pierce and Jeff went further to discuss how important 
thinking discretely (e.g., thinking about the accumula¬ 
tion of small chunks) was to the computational endeavor. 
More junior interviewees (Annie and Britta) did not 
raise issues of computational thinking specifically. Some 
of their discussions about specific tasks they completed 
could have encapsulated computational thinking, but di¬ 
rect probes were not taken up. It might not be surpris¬ 
ing that more junior interviewees struggled to articulate 
ideas around computational thinking as they have not 
had the benefit of years or decades of working with com¬ 
putation that more senior interviewees have had. 

Ways of connecting mathematics, physics, and 
computational ideas 

In their discussions, conference participants extended 
these ways of thinking beyond “iterative thinking” to in¬ 
clude what we will refer to as the math-physics-eomputing 
connection. According to participants, students who 
have developed this connection are able to move flu¬ 
idly between mathematical, physical, and computational 
ideas and are able to see how each affects the other. In 
interviews, each participant discussed the math-physics¬ 
computing connection. Pierce, an engineer who manages 
a team that is developing hardware and software for ex- 
ascale supercomputing, mentions how challenging it is to 
find such expertise, 

Pierce ...one of the things that’s very scarce 
in the people who we look for is the knowledge 
of the actual physics and the mathematics and 
the numerical mathematics that goes into a 
lot of the simulation programs. 

It might appear that Pierce’s discussion of knowledge is 
simply ideas or concepts related to each of these different 
areas, but it’s more clear from other parts of his interview 
that he is discussing connections. 

Pierce If you don’t really have a fundamen¬ 
tal understanding of what you are doing in 
the mathematics that will affect the represen¬ 
tation of the physics, then you could be doing 
things [with the computer] that are just going 
to be useless later on. 


While all of the more senior interviewees raised the 
connection between mathematics, physics, and comput¬ 
ing explicitly, more junior interviewees (Britta) discussed 
them more implicitly - often couched in the particulars 
of their work. This is, again, not terribly surprising given 
the much wider experience with computation that more 
senior interviewees have had. 

Meta-knowledge about computation 

In addition to knowledge and practices that support 
doing computation, conference participants voiced that 
students should develop meta-knowledge about what 
computing can do and what tools are appropriate for cer¬ 
tain tasks. In interviews, developing this meta-knowledge 
was presented by more senior interviewees (Frankie, Jeff, 
and Leonard), but discussions about choosing specific 
tools were absent. Meta-knowledge discussions were ab¬ 
sent in interviews with more junior interviewees. Frankie, 
a professor who runs a soft matter lab, discussed how stu¬ 
dents should develop a meta-level understanding about 
what computation can buy them. 

Frankie I want students to recognize that 
when [a diffusive system] runs to equilibrium, 
you’re solving the Laplace equation because 
the time derivative is zero when in equilib¬ 
rium. 

Here, Frankie is speaking about helping students make 
the connection between solving the diffusion equation 
numerically and solving Laplace’s equation analytically. 
She later articulates why she wants students to do this, 

Frankie I had students solve problems nu¬ 
merically that they could also solve analyti¬ 
cally... calculate the first 50 terms [of an infi¬ 
nite series solution to Laplace’s equation] and 
compare that to the computational [solution]. 

Once you gain the ability to get that more or 
less right, then you can start solving problems 
where you don’t know the answer. 

Frankie is both helping students understand analytic 
solutions that contain infinite series and demonstrat¬ 
ing that the computer can produce an accurate solution 
that fits with students’ analytical work. We infer that 
Frankie is, in part, working to help students build meta¬ 
knowledge about what computation can do. Other senior 
interviewees expressed similar sentiments, for example, 
Jeff and Leonard suggested that students should under¬ 
stand that most problems cannot be solved analytically. 

Developing professional practices 

Finally, conference participants raised issues of profes¬ 
sional practice. We distinguish these practices from com¬ 
putational practices because they are more closely related 
to working in a team environment (e.g., co-developing 
software). For many participants, documenting code 
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and using version control were paramount to working 
well on teams that develop complex codes. These senti¬ 
ments were echoed by Jeff, who develops an open-source 
package for astrophysical calculations and Britta, who is 
working from poorly documented code. 

Jeff ...when you write code in a research 
group, you are going to be forced to support it 
until you die...even though it takes 20 percent 
longer, it’s a good idea to make it readable 
and document it and use version control... 

Britta .. .we have a code that was written by 
a previous postdoc and he does not like to re¬ 
spond to emails. So, there’s a lot of error 
messages and I have to try to figure out why. 

In other parts of her interview, Britta expressed frus¬ 
tration with her project (e.g., persistent errors). She did 
not discuss how her frustration might be connected to 
the professional practices that Jeff mentioned (e.g, prop¬ 
erly documented code). As Britta has worked in compu¬ 
tational physics for 4 years and exclusively in small re¬ 
search groups, it is likely that she has not yet recognized 
the importance of these professional practices. By con¬ 
trast, Jeff’s years of experience developing software has 
required him to make use of these practices extensively. 

V. DISCUSSION AND CONCLUSIONS 

In this study, we collected diverse ideas presented by 
conference and interview participants into several prelim¬ 
inary categories of computational “skills.” As discussed 
(Sec. IIII|) . we have taken a broad view of computational 
skills. The categories we have presented (Sec. ITV|1 do 
not represent an exhaustive list of computational skills, 
but this list does collect the different ways that our pop¬ 


ulation spoke about what computational skills students 
should develop in their undergraduate physics program. 

It is worth noting that these categories are not with¬ 
out nuance. For example, we have found a recurring 
divide among the ways in which different generations 
of computational physicists discuss what skills are im¬ 
portant for students to learn. More junior interviewees 
were more likely to ground their discussion in particular 
projects. Additionally, some skills (e.g., computational 
ways of thinking) were generally absent from interviews 
with more junior interviewees. Both of these results likely 
stem from the fact that more senior interviewees have 
more and broader experiences with computation. These 
more senior participants appear to draw on and synthe¬ 
size those experiences in our interviews. 

The result of this research is a preliminary list of com¬ 
putational skills that can act as starting point for de¬ 
veloping more concrete curricular and pedagogical struc¬ 
tures for teaching computation. A recurring theme not 
presented in this study was that all interview partici¬ 
pants developed their computational physics expertise 
outside of the physics curriculum; they were self-taught. 
It was the sentiment of conference participants and inter¬ 
viewees that this self-teaching practice is insufficient to 
deal with the needs placed on future physicists by grad¬ 
uate schools and industry. That is, we require new and 
different ways of incorporating computational instruction 
going forward. 
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